SUBSTITUTE SPECIFICATION 

SPECIFICATION 
TITLE 

"METHOD FOR PRODUCING AN IMAGE" 
BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to a method for producing an image from a 
three-dimensional image of a subject. 
Description of the Prior Art 

Images that are picked up with modern imaging medical devices have a 
relatively high resolution in all directions, and therefore more and more 3D 
acquisitions (volume datasets) are performed with them. Medical Imaging devices 
include ultrasound devices, computed tomography devices, magnetic resonance 
devices or X-ray devices or PET scanners, for example. Computed tomography or 
X-ray devices nowadays can more frequently be utilized, because the radiation dose 
to which a living being is exposed during an examination with one of these devices 
has decreased. Volume datasets however contain a larger amount of data than 
image datasets of conventional two-dimensional images, which is thereon why an 
evaluation of volume datasets is relatively time-consuming. The actual pick-up of the 
volume datasets currently takes approximately half a minute, but it frequently takes 
half an hour or more to search through and edit the volume dataset. Methods for 
automatic recognition and editing are needed and desirable. 

Furthermore, it may occur that fine structures are submerged, particularly in 
the representation of large volume datasets, i.e. contrast agents are needed in order 
to make such fine structures visible. This is true of the representation of small 
vessels, for example. 
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Until the year 2000, it was customary practice in computed tomography (CT) 
to reach a diagnosis based almost exclusively on axial slice stacks (slice images) or 
at least to base findings predominantly on the slice images. Since 1995, due to the 
power of new computers, 3D representations on diagnostic consoles have been 
widespread; initially they had a scientific or ancillary importance. Essentially four 
basic methods of 3D visualization were developed in order to facilitate diagnosis by a 
physician: 

1. Multiplanar reformatting (MPR): This is just a reconfiguration of the volume 
dataset in different orientation ... the original view of horizontal slices. It basically 
breaks down into orthogonal MPR (three MPRs, respectively perpendicular to a 
coordinate axis), free MPR (oblique slices; derived = interpolated) and curved MPR 
(slice representation parallel to an arbitrary path through the image of the body of the 
living being and e.g. perpendicular to the MPR in which the path was drawn). 

2. Shaded Surface Display (SSD): segmenting the volume dataset and 
representing the surface of the object that has been identified, usually strongly 
influenced by orienting on the CT values and manual auxiliary editing. 

3. Maximal Intensity Projection (MIP): representation of the highest intensity 
along each ray. In what is known as thin MIP, only a sub-volume is represented. 

4. Volume rendering (VR): encompasses modeling of the attenuation of the 
eye ray that penetrates the subject in a similar manner as an X-ray. The entire depth 
of the imaged body (partly translucent) is captured; however, details of small and 
especially thin-sliced subjects are lost. The representation is adjusted manually by 
the setting of so called transfer functions (color lookup tables). 
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Another important technique for rapid visualization, which is not actually a 3D 
method, is movie-like immersion down into a slice stack m of which one slice after 
the other is displayed. 

United States Patent No. 4,879,652 describes a method for a special shaded 
representation of a subject that is imaged in a volume dataset. The volume dataset 
is produced with a nuclear medical device. 

United States Application Publication 2002/0164061 and United States Patent 
No. 5,425,407 describe methods for recognizing contours that are imaged in a 
medical image. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide a method that produces an 
improved representation of image contents of volume datasets. 

This object is achieved in accordance with the invention by a method for 
producing an image including the steps of storing a three-dimensional image of an 
object as a volume dataset, computerized segmentation of the curved surface of the 
stored three-dimensional image of the object, transforming the volume dataset so 
that the segmented curved surface is transformed into a plane, and representing the 
curved surface of the three-dimensional image subsequent to its transformation into 
a plane with a slice of predetermined thickness inside and/or outside the three- 
dimensional image. 

With the inventive method, an intensive search through the complete volume 
dataset for specific queries can be automated and thus simplified and accelerated for 
the physician. With the inventive method, a type of "curved MIP" is created; i.e., a 
complex reformatting of the image contents of the volume dataset is performed. This 
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occurs parallel to the segmented surface of the three-dimensional image of an object 
rather than perpendicular to a plane and parallel to a line like in curved MPR. 

First, the surface of the three-dimensional image is automatically defected 
(segmented). This typically curved surface is then transformed into the plane as if 
the three-dimensional image were to be unrolled. The projection of the surface of 
the earth on maps is an analogy . Particularly when the subject is the torso of a 
living being which has a quasi-columnar shape with an approximately elliptical base, 
the surface can be unrolled into a flat area. 

If the three-dimensional image takes the form of consecutive computed 
tomography slice images, and the image data of each slice image are described in 
Cartesian coordinates (e.g. representation of tissue or structures near the body 
surface (e.g. the shim) or along a tubular bone), as in a preferred embodiment of the 
invention, then the segmentation of the surface of the three-dimensional image can 
be as follows. 

A coordinate transformation is performed for each slice image to polar 
coordinates relative to a line that extends through the three-dimensional image and 
is oriented at least substantially perpendicular to the individual slice images. The 
contours that are imaged in each transformed slice image are determined and 
allocated to the surface of the three-dimensional image. The pixels of the contours 
that have been determined are transformed back into the coordinate system that is 
allocated to the volume dataset. Pixels are -re-extracted along the contours for the 
display of the surface, with predetermined slice thickness inside and/or outside the 
three-dimensional contours. 

The unrolled flat representation of the surface of the three-dimensional image 
comprises a slice of predetermined thickness below and/or above the surface. The 
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thickness equals several millimeters when blood vessels are being examined, for 
example. In the examination of the structure of tubular structures, the thickness may 
equal almost a centimeter, and in an examination of the meninges, the slice is again 
relatively thin. In this hemispherical configuration, there is a close resemblance to 
cartographic projection, or a strip shaped reorganization is possible in the sense of 
the article "Volume Rendering" (R. Drebin, Computer Graphics 22 (4), August 1988: 
65-74). 

For the slice of predetermined thickness of the generated image plane, 
depending on the problem, a reasonable computation technique is applied for the 
pixels arranged one behind the other, depending on the requirements of the 
representation. Margin conditions at a variable or constant spacing of the structure 
of the surface being searched for, noise that may have to be suppressed, the 
characteristic that a structure has a higher density than the environment (vessels 
filled with contrast agent), calcifications), or some other feature (higher-order 
statistics). Because only the image of the surface and the imaged slice of 
predetermined thickness are represented, contrast is gained. 

According to a preferred variant of the invention, the three-dimensional image 
is an image of at least part of a living being, and the segmented surface is the image 
of the body surface of the imaged living being. 

The image of the body surface of the living being or images of slices near the 
skin to defined depths can be automatically represented. Possible applications 
include preparation for plastic surgery, preparation for vascular surgery, melanoma 
screening, and many more applications. For instance, it is possible to render high- 
resolution representations of the subcutaneous vascular tree. 
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The inventive method is not limited to the body surface (skin); rather, a further 
embodiment of the invention provides that the subject is a bone or organ of a living 
being. Thus, the surface of a deeper organ or a boundary surface within an organ 
can be examined. Bone examinations (condition of trabecula) for evaluating the 
growth or decay (in osteoporosis) are also possible applications. 

In order to obtain different views of the transformed surface, embodiments of 
the invention provide that the transformed plane is oriented in the line of sight into 
the three-dimensional image and/or the line of sight away from the three-dimensional 
image. The surface being examined or its image, respectively, can thus be 
examined from different points of view. 

For different representations of the slice of predetermined thickness, the 
image data that are allocated to the slice of predetermined thickness can be 
represented by means of MPR (multiplanar reformation), MIP (maximal or minimal 
intensity projection), volume rendering (VR) and/or filtering (smoothing, edge 
accentuation or otherwise structure accentuation). 

DESCRIPTION OF THE DRAWINGS 

Figure 1 is a computed tomography apparatus operable in accordance with 
the invention. 

Figure 2 is a three-dimensional image of the ventral area of a patient in the 
form of a volume dataset consisting of several slice images. 

Figure 3 is a slice image of the volume dataset represented in Figure 2. 

Figure 4 shows image information, after transformation to polar coordinates, 
of the slice image represented in Figure 3. 

Figure 5 is an image dataset representing the image of the body surface after 
transformation into a plane and an image of a slice adjacent the body surface. 
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Figure 6 is the image that is an embodiment of the image dataset shown in 
Figure 5. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Figure 1 is a schematic representation of a computed tomography apparatus 
with an X-ray source 1 which emits a pyramidal X-ray beam 2 i the peripheral rays of 
which are represented as dotted lines in Figure 1, which passes through an 
examination subject, for instance a patient 3, and strikes a radiation detector 4. This 
X-ray source 1 and the X-ray detector 4 are disposed facing one another on opposite 
sides of an circular gantry 5. The gantry 5 is supported by a bearing device that is 
not shown in Fig. 1, such that it pivots relative to a system axis 6 that extends 
through the midpoint of the annular circular 5 (arrow a). 

In the exemplary embodiment, the patient 3 lies on a table 7 that is 
transparent to X-ray, which is supported by means of a bearing device that is not 
shown in Figure 1 in such a way that it can be displaced along the system axis 6 
(arrow b). 

The X-ray source 1 and X-ray detector 4 form a measuring system which is 
rotatable relative to the system axis 6 and displaceable along the system axis 6 
relative to the patient 3, so that the patient can be irradiated at different projection 
angles and different positions relative to the system axis 6. From the generated 
output signals of the radiation detector 4, a data acquisition system 9 forms 
measurement values, which are fed to a computer 11, which computes, by methods 
known to those skilled in the art, an image of the patient 3 that can be reproduced on 
a monitor 12 that is connected to the computer 11. In the exemplary embodiment, 
the data acquisition system 9 is connected to the radiation detector 4 by an electrical 
line 8, which terminate in a wiper ring system, or a wireless transmission path, to 
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obtain signals from the radiation detector 4, and is connected to the computer 1 1 by 
an electrical line 10. 

The computed tomography apparatus shown in Figure 1 can be utilized for 
sequential scanning and spiral scanning. 

In sequential scanning, the patient 3 is scanned slice by slice. The X-ray 
source 1 and the X-ray detector 4 are rotated around the patient 3 relative to the 
system axis 6, and the measuring system, which includes the X-ray source 1 and the 
X-ray detector 4, captures a number of projections in order to scan a two- 
dimensional slice of the patient 3. From the measurement values so acquired, a 
slice image representing the scanned slice is reconstructed. Between the scanning 
of consecutive slices, the patient 3 is moved along the system axis 6. This process 
is repeated until all relevant slices are picked up. 

During a spiral scan, the measuring system formed by the X-ray source 1 and 
the X-ray detector 4 rotates relative to the system axis 6, and the table 7 moves 
continuously in the direction of arrow b; that is, the measuring system comprising the 
X-ray source 1 and the X-ray detector 4 continuously moves on a spiral path c 
relative to the patient 3 until the region of interest of the patient 3 is completely 
covered. A volume dataset is thereby generated, which is coded according to the 
customary DICOM standard in the present embodiment. 

In the exemplary embodiment, a volume dataset of the ventral area of the 
patient 3 consisting of several consecutive slice images is generated with the 
computed tomography apparatus represented in Figure 1. The volume dataset that 
is represented schematically in Figure 2 comprises approximately 250 CT slices 
(slice images) of the matrix 512x512. Figure 2 shows seven slice images as an 
example, which are indicated by reference characters 21 to 27. 



8 



SUBSTITUTE SPECIFICATION 

In the exemplary embodiment, the body surface that is imaged with the 
volume dataset and the imaged tissue and imaged vessels immediately beneath it 
are represented. To that end, in the exemplary embodiment, a suitable computer 
program runs on the computer 1 1 , which executes the steps described below. 

First, for determining the imaged body surface, each slice image 21 to 27 of 
the volume dataset is transformed to polar coordinates (r,cp) relative to a line G 
through the three-dimensional image of the stomach region of the patient 3 in a first 
pass. The line G is oriented at least substantially perpendicular to the individual slice 
images 21 to 27. In the exemplary embodiment, the line G extends through the 
center of the volume dataset and corresponds to the z-axis of the coordinate system 
that defines the volume dataset. 

In the exemplary embodiment, each slice image 21 to 27, of which the slice 
image 21 is exemplarily represented in Figure 3, is described with Cartesian 
coordinates (x,y). Next, the image information of each slice image 21 to 27 is 
rearranged radially, being transformed to polar coordinates (r,cp) relative to the line 
G, i.e. relative to the respective point of intersection between the line G and the 
corresponding slice image. As an example, the point of intersection S between the 
line G and the slice image 21 is represented in Figure 3. With the transformation to 
polar coordinates (r,cp), the image of the body surface of the patient 3 is also 
transformed, being represented as a closed contour in each transformed axial slice 
(slice image). Figure 4 represents an example of a contour 41 that corresponds to 
the image of the body surface of the patient 3 for the slice image 21 subsequent to 
its transformation to polar coordinates (r,cp). 

The result of the transformation to polar coordinates (r,cp) is a linearly mapped 
radial brightness profile. In this rectangular matrix (extracted image matrix), a 
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filtering is performed, which accentuates the contours that are allocated to the body 
surface, such as the contour 41 represented in Figure 4. The filter responses 
replace the brightness values in the extracted image matrix. Next is the search for 
the optimal path in this image matrix from top to bottom at the identical start 
point/end point. In the exemplary embodiment, this occurs by means of dynamic 
optimization, such as described in Dynamic Programming and Stochastic Control 
Processes (R. Bellmann, Information and Control 1(3), September 1958: 228-39). 
The optimal path represents the radial vectors to the body surface pixels. In a 
further step, the contours 41 that have been transformed to polar coordinates are 
transformed back into the original coordinates of the volume dataset, so that the 
whole contour ensemble that is determined from the individual contours of the slice 
images 21 to 27 and the corresponding pixels of the original volume dataset are 
checked in relation to the individual contours across all slice images 21 to 27. This 
contributes particularly to the suppression of errors (overshoots) and to reliability. At 
the probable points of error, re-segmentation is performed in the individual slice 
images 21 to 27, with subsequent checking of the 3D context. The image of the 
patient 3 in the volume dataset has thus been segmented. 

In the exemplary embodiment, this is followed by a re-extraction at a right 
angle to the image of the segmented body surface in the volume dataset. Whereas, 
in the transformation to polar coordinates (r.cp), brightness profiles were computed 
from the original data at a right angle to all points of a circle (idealized surface 
contour) and mapped as a rectangular matrix, in the re-extraction, profiles are 
obtained at each pixel of the image of the segmented body surface (body surface 
contour) at a right angle to the deflected surface. This re-extraction is remapped as 
a rectangular matrix. A vertical line herein, for instance the centerline, corresponds 
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to the pixels of the image of the body surface. For example, to the left of this vertical 
line are the CT measurement values near the body surface on the inside. The 
volume dataset is thus transformed such that the segmented image of the body 
surface of the patient 3 is transformed into a plane. Thus, depending on the 
problem, a slice below and/or above the segmented surface that has been 
transformed into a plane — in the exemplary embodiment, the segmented and 
transformed image of the body surface of the patient 3 — is calculated for 
measurement value determination (re-extraction). The thickness of this slice it is 
entered into the computer 11 prior to re-extraction in the case of the present 
exemplary embodiment. As a result, an image dataset 51 emerges as represented in 
Figure 5, which has the structure of a thin voxel cuboid. 

In the exemplary embodiment, the thickness of the slice adjacent the body 
surface is some 5 mm. It is thus possible that, in the exemplary embodiment, 
vessels situated just below the skin of the patient 3 in the groin area can be 
represented without contrast agent. Above this thickness of 5 mm, the highest 
density is computed perpendicular to the body surface, and a thin MIP is generated, 
but, with reference to the original volume data, along the curved image of the body 
surface. For an evaluation, the image dataset 51 that is represented in Figure 5 can 
be utilized, the corresponding image 61 of which is represented in Figure 6 and 
displayed on monitor 12. 

The minimum can be utilized instead of the maximum signal value, or some 
other calculation can be performed for other problems. For relatively thick 
structures, for example, an improvement of the signal/noise ratio can be achieved 
with the aid of an average formation or some other smoothing operator. With the 
selection of a narrow band of signal values (e.g. Hounsfield units), it is possible to 
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select structures with particular characteristics (e.g. blood vessels, calcifications etc.) 
or to fade such structures out in complementary fashion. 

With analysis in the plane parallel to the orientation plane (Figure 5), the 
measurement values can be analyzed and visually displayed in the "horizontal" 
context of their plane (e.g. in their texture characteristics). 

In the exemplary embodiment, the volume dataset is produced with a 
computed tomography apparatus. For the inventive method and the inventive 
medical device, the volume dataset can also be produced with some other imaging 
device, such as a magnetic resonance device, X-ray device, ultrasound device, or 
PET scanner. The volume dataset need not take the form of several consecutive 
computed tomography slice images. 

The image that is to be segmented need not be the body surface of a living 
being. In particular, the inventive method is suited for images near any surfaces, 
with special respect to surfaces of organs, vessels or bones 

Although modifications and changes may be suggested by those skilled in the 
art, it is the intention of the inventor to embody within the patent warranted hereon all 
changes and modifications as reasonably and properly come within the scope of his 
contribution to the art. 

CH1\ 4218327.1 
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